Computer assisted data collection for surveys and the like

ABSTRACT

An exemplary MMIC (“Multi-Mode Interviewing Capability”) survey program is a computerized tool that supports various traditional modes of collecting interview data, including telephone interviewing, written interviewing, and personal interviewing, and can be used to manage the whole interview process from questionnaire design, sample management, and fieldwork monitoring to final dataset production. The collected data may also include non-textual data from survey participants such as medical measurements of blood pressure and heart rate. Self-interviewing using the Internet is also possible which permits real time availability of results and the participation of respondents from virtually anywhere in the world, using devices such as PDA&#39;s, Smart phones and Web TV&#39;s. The MMIC survey structure is non-linear and object oriented, which permits a connection between all the building blocks of the survey to be defined on any level. The compiled survey includes sufficient metadata to facilitate decompilation and the production of equivalent source code in any supported programming language, whether or not it was originally programmed in that language. This stored metadata not only allows researchers to later trace back the exact conditions under which this particular answer was given, but also permits results from multiple iterations of the related surveys to be combined in a rigorous manner that will be transparent to subsequent analysis and research.

This application is a divisional application of U.S. patent applicationSer. No. 11/415,913, filed May 1, 2006, entitled “COMPUTER ASSISTED DATACOLLECTION FOR SURVEYS AND THE LIKE”, which claims priority of U.S.provisional patent applications 60/682,204 and 60/696,620 filed on May17, 2005, and Jul. 1, 2005, respectively, which are hereby incorporatedby reference in their entirety.

FIELD OF INVENTION

The present invention relates generally to computer-assistedinterviewing and other survey-oriented data collection technology. Morespecifically, an exemplary embodiment of the present invention includesa suite of computerized tools for managing an entire interview processfrom questionnaire design, sample management, and fieldwork monitoringto final dataset production and analysis.

BACKGROUND OF THE INVENTION

Blaise® [see http://www.cbs.nl/en/service/blaise/introduction.htm] is acomputer-assisted interviewing (CAI) system and survey processing toolfor the Windows® operating system. The system was developed byStatistics Netherlands and has been designed for use in officialstatistics. It is available to National Statistical Institutes andrelated research institutes. C2B (CentERdata to Browser) [seehttp://www.uvt.nl/centerdata/en] is an add-on to the Blaise productwhich facilitates publication of a Blaise questionnaire to the Internet.using a ‘standard’ Blaise questionnaire. CASES [seehttp://cases.berkeley.edu] is a software package for collecting surveydata based on structured questionnaires in both governmental and privatesectors. Survent [see: http:/www.cfmc.com] is a system forcomputer-assisted telephone interviewing (CATI) which provides completecapabilities for designing, administering, and managing all of thecomplexities of sophisticated telephone-based research operations. SPSS[see http://www.spss.com] is a statistical software package foranalyzing numeric data and for producing graphical representations ofdata.

These and other known survey tools typically utilize proprietarystructures and programming languages that are relatively complex for thelimited functionality which they support. Thus the programmer and theresearcher have only limited control over the survey design, and onlylimited capability for analyzing the results and possible modificationsto the questionnaire design as the survey is being conducted. Moreover,especially for large, recurring surveys involving many questions andmany participants, relatively large development times are required,translation of the survey text into other languages is cumbersome, andthe survey documentation is not presented in a format which isunderstandable to other than a trained programmer having extensiveexperience with that particular programming language.

SUMMARY OF THE INVENTION

In one presently preferred embodiment (hereinafter designated “MMIC”),there have been implemented a number of major improvements to theconventional questionnaire structure. This MMIC structure is non-linearand object oriented, which permits a connection between all the buildingblocks of the survey to be defined on any level. Fills used in questiontexts point to basic Field Object blocks, including explicit links toall the conditions used for that specific Field Object as well as linksto all the statements assigned to a Field Object. This makes it possibleto retrieve all the possible fills for any given Field Object, which inturn permits the MMIC Engine to have full control over the meta data atdesign time and not only at run time.

A second improvement as implemented in that preferred embodiment is theability to recreate new source files based on the compiled MMIC objects.At any time, a compiled MMIC Datamodel Object can be decompiled toproduce source code in any supported programming language, whether ornot it was originally programmed in that language. This has the addedadvantage that you do not necessarily have to design or modify aquestionnaire using a formal programming language.

Another improvement as implemented in the currently preferred embodimentis that the MMIC Datamodel Object is aware of all the routing and otherfunctional connections between the different building blocks and candisplay the statements and conditions related to the current questionwhile the interview is in progress, which enables a programmer to debugthe source code faster and with more accuracy. The programmer is alsoable to assign watches to all necessary fields so that these relatedstatements and conditions can be viewed at real time during debugging.

BRIEF DESCRIPTION OF THE FIGURES

For a fuller understanding of the principles underlying the presentinvention, and how its various aspects can be put to practical use,reference is made to the appended drawings, in which:

FIG. 1 shows an overview of an exemplary MMIC Engine;

FIG. 2 shows how the MMIC Engine of FIG. 1 includes two basic buildingblocks. The Datamodel Object and the Database Object;

FIG. 3 shows an overview of MMIC and external programs;

FIG. 4 shows an example of a short MMIC program (written in the Blaiseprogramming language) which defines an exemplary MMIC questionnaire;

FIG. 5 shows how the questionnaire of may appear in a graphical userinterface;

FIG. 6 is a screen dump of a typical MMIC programming environment;

FIG. 7 is a screen dump of an exemplary CATI/CAPI environment for theMMIC survey system;

FIG. 8 is a screen dump showing an exemplary listing of completedrecords for a simple survey;

FIG. 9 is a screen dump of a typical MMIC sample management system;

FIG. 10 is a screen dump of an exemplary MMIC meta data viewer;

FIG. 11 shows certain structures of an exemplary MMIC Datamodel Object;

FIG. 12 shows some of the basic components of an exemplary Field Object;

FIG. 13 shows how the Datatype Object of FIG. 11 describes the type ofdata to be stored for a specific Field Object; and

FIG. 14 shows the source code for an exemplary MMIC question constructedfrom a Fill in a Question Text.

DETAILED DESCRIPTION OF CERTAIN EMBODIMENTS

The present invention potentially encompasses a number of embodiments ofvarying functionality and complexity which may be used in variouscombinations and subcombinations to satisfy different needs of differentusers. Accordingly, although only a few examples of certain preferredembodiments of the present invention will be described in detail, itwill doubtless be apparent to those skilled in the art how othercombinations and subcombinations of the described embodiments may beused in other environments to satisfy the needs of other users.

FIG. 1 show a functional overview of an exemplary Engine 10 having a“multi-mode interviewing capability” (“MMIC”). This MMIC survey programis intended to support multiple methods of designing a questionnaire(“Data Model”), via a Programming Interface which preferably is capableof communicating with the programmer in various languages (such asBlaise, CASES, and native MMIC) and display modes (such as Text, Web orGraphic User Interface (“GUI”)), and which will be described in moredetail later in this document. In the Data Model design phase, the mainMMIC Engine 10 is informed what questions 12 are being asked, in whatorder 14, and in what Database format and Layout 16. This informationforms a Data Model, which is processed in the main MMIC Engine 10 andstored (together with any responses via the Interview Interface) in aseparate data storage module 18. Once designed, the data entry part 22of the process is able to retrieve these Question Texts 12 and routing14, displaying questions in a number of different formats and modes. TheMMIC survey program preferably supports a number of alternative computerassisted interviewing modes, including but not limited to CATI (ComputerAssisted Telephone Interviewing) and CAPI (Computer Assisted PersonalInterviewing).

MMIC Design

As shown in FIG. 2, the main MMIC Engine 10 consists of two basicbuilding blocks: the Datamodel Object 24 and the Database Object 26.

The Datamodel Object 24 holds the structure for the entirequestionnaire. It stores the questions (in the form of Field Objects 28)to be asked in the questionnaire and the order (in the form of Rules 30)in which they are asked. Datamodel Object 24 also stores Layout Objects32 which determine the manner in which the various Field Objects 28appear to the interviewer and/or respondent. The structure of thevarious MMIC Datamodel Objects are described in more detail hereinafterwith respect to FIG. 11, FIG. 12, and FIG. 13.

FIG. 3 shows an overview of MMIC and external programs. In order tofacilitate these external programs and usages, the MMIC survey system issetup in a modular or object oriented fashion. All internal componentsare connected to each other. The Database Object 26 communicates(retrieves and stores information) with an external third party database34 such as Oracle, dBase or mySQL. The Database Object 26 is onlypointing to referenced data stored in the third party database and isnot holding the actual data. The third party database stores not only aparticipant's response, but also the context such as the date and timeof each entry, the language in which this question was asked, theinterviewing mode (web interview, telephone interview, etc.) and theversion of the questionnaire in which the question was asked.

Other related utility programs may be provided such as a SampleManagement System 36, an Interview Interface 38, a Programming Interface40, and a Report module 42 which outputs Responses and Meta Data. Thesevarious utility programs 36, 38, 40, 42 are preferably external to themain MMIC Engine 10, but which collectively simplify the task ofcreating, running, and analyzing a survey under the overall managementof the MMIC Engine.

Programming Interface

Programming of a MMIC questionnaire can be done in a number of ways andis preferably performed by means of an external Programming Interface40. The researcher can use a programming language FIG. 4 a webinterface, or a graphical user interface FIG. 5. The graphical userinterface enables the user to click together a questionnaire by draggingand dropping boxes 44 for the questions 12, and arrows 46 for therouting 14, without needing to know a programming language. The primaryfunction of the programming interface (whether it is a programminglanguage, a web interface or a graphical user interface) is to fill theMMIC Engine Object 10 with information about the survey and the flow ofthe survey. The programming language describes all the questions 12 thatcan be asked in the survey, and the conditions 14 that determine whatquestions are going to asked and in what order. In case the survey isdesigned using a text-based programming language, the typed text istypically parsed and then assigned to the MMIC Datamodel Object. Theparser is not part of the MMIC Datamodel Object but rather is includedwithin the text-based portion of Programming Interface 40 and is onlyresponsible for the interpreting the typed text by the programmer. Theparser determines what parts of the typed text are Fields, Statements orConditions (see FIG. 13) and assigns these parts to the MMIC DatamodelObject. The MMIC Datamodel Object has an internal compile function,which receives the parsed program text from the Programming Interface 40and informs the user whether there are any errors in the programmedsurvey. These errors can be of different types. A user could forget tospecify the answer possibilities to a question, or could make a mistakein a related Condition, for example, checking for a number although thequestion was designed to have only yes-no answer categories.

FIG. 4 shows an example of a short MMIC program (written in aBlaise-like programming language). The programmed questionnaire has twoquestions. The first question (q1) determines whether the secondquestion (q2) is being asked. If someone answers yes to the question “Doyou have a dog,” the name of the dog is asked (q2). This short exampleshows the two important parts of the survey system: Fields and Rules.First the fields 44 are defined under the ‘Fields’ section 48 and laterthe routing 46 is defined under the ‘Rules’ section 50. The fields inthis example are used as functions: they represent questions to be askedof the respondent, and accept input from the user.

As shown in FIG. 5, the same questionnaire will look a little differentin the graphical user interface by means of which the researchers (orprogrammers) are able to design the questionnaire using graphic symbolssuch as arrows and boxes. FIG. 6 is a screen dump and shows how the samequestionnaire will look in the MMIC programming environment. Thisenvironment is basically a text editor that uses syntax highlighting tomake life easier for the programmer. Once a survey is programmed (inthis case our simple dog example) a programmer can use the dropdown boxunder actions or the compile button on the top of the screen to compilethe programmed questionnaire. In case of an error the programmer will bedirected to the location in the source file where the problem or erroroccurred. After compiling the programmer can choose to run the survey inweb or CAPI/CATI mode.

Interview Interface

As shown in FIG. 7, the Interview Interface 38 consists of a data entryprogram capable of conducting web interviews, personal interviews andtelephone interviews. In any of these interview modes, the interfacetypically presents the interviewer or respondent with a question 12 andallows the interviewer or respondent to enter an answer 52 a, 52 b tothat question. Referring specifically to the screen dump of an exemplaryCAPI/CATI environment for the MMIC survey system shown in FIG. 7, onlythe first question q1 on the route for our ‘dog’ survey is visible. Incase the “yes” 52 b branch is selected, the appropriate Question Textand edit box 54 for q2 will open on the bottom of the screen, allowing ainterviewer or respondent to enter a name for the dog. FIG. 8 is ascreen dump showing a simple listing of the completed records for thissurvey. Apparently only two of our respondents had dogs, one named Tommyand one named Bob.

Sample Management System

Reference should now be made to FIG. 9, which is a screen dump of atypical MMIC sample management system. A survey involves a number ofquestions each directed to a statistically meaningful set 56 (a“sample”) of respondents 58 selected from a larger universe of potentialrespondents. Managing a sample is a vital part of any efficient survey,in order to issue calls and determine what to do with each samplerecord. A sample consists of potential respondents in the form ofseveral individual records 60. The records are made up of manyvariables. Record variables store information about each record, such astelephone number 62, name 58, language spoken, or postal code. Thesample is loaded into the Sample Management System (“SMS”) and held in atable 64 in a database.

In the tables, the SMS stores the records it reads from the samplefiles. Once a sample has been loaded, it remains in the SMS and recordsare moved from table to table according to their current status 66 andrules that determine the selection of a record and its disposition oncethe interview has been completed. Although these are the most importantfunctions, many other rules can be defined as well. These might includecustom reports, automatic sample loads, or periodical printouts ofappointment schedules.

Global characteristics of the study usually set the standards or limitsfor the study as a whole. For instance, a study variable might be set todefine the maximum number of attempts allowed per record, or to indicatethe time delay required before calling back busy numbers. The values ofstudy variables are not permanent, and supervisors with the properpermissions can change them at any time while interviewing is inprogress, without changing the SMS algorithms.

Meta Data and Report Module

As shown in FIG. 10, Meta data 68 describes the content and the flow ofthe questionnaire. Possible tools for meta data descriptions includeprograms for the generation of a paper version of the questionnaire andan overview of variables and questions used in the survey.

Datamodel Object

FIG. 11 shows some of the most important structures of the main MMICDatamodel Object 24. When a question is programmed, the properties ofthis question (called a “field” in the MMIC programming language), suchas “question text” and “name”, are accessible from any point in thesurvey and not just when it appears on the route during an interview. Itis possible to browse through all the conditions in the questionnaireand directly link to questions involved in the conditions. These linksare stored in the form of pointers to Field Objects 70. The actual field(question) is stored only once in the Datamodel Object as a FieldObject. A Field Object can operate in different ways in a survey. It canact like a variable in conditions or assignments, but it can also act asa procedure call (function) to display a question text on the screen andto store an answer given by the respondent or interviewer. The MMICField Object is described in more detail hereinafter with reference toFIG. 12.

The light gray (striped) boxes in this structure represent lists ofobjects. So, the Fields box may point to one or more fields (questions)that are asked in the questionnaire and/or to fields (assignments) thathave values that are automatically assigned (such as the date and timeof the survey).

The Rules list describes the flow of the questionnaire, and in effectconstitutes a blue print of the possible events during a survey. TheRules list consists of statements, conditions (conditional logic), andchecks.

Statement Object 74 represents an assignment or question (which act likeexecutable command lines) in the survey. A statement can be either thefact that a question is being asked (in this case the field is used as afunction), or an assignment to a field (for example to set the time thatthe survey started), or the monthly income of a respondent in case theincome was given on a yearly base (here the field is used as avariable).

The Condition Object 76 represents the conditional logic under which aStatement Object is executed. Conditions (conditional logic) determinewhether a question is asked or not. If there is a series (block) ofquestions about someone's children, the respondent might not be asked ifa question before the series of children questions asks the respondentwhether he/she has any children, and the response is “no”. The series ofchildren questions can be restricted by a condition based on thisquestion about having any children at all. Conditions are stored in aCondition Object. Checks are a somewhat more complex form of conditionallogic that does more than simply examine prior responses to determinewhether or not a specific question (or series of questions) should beasked, but rather analyzes the current response for possibleinconsistencies with prior responses, and, if a possible inconsistencyis detected, issues a warning or error message to the interviewer and/orprovides the respondent with an opportunity to revise or expand on thatresponse. A typical example is when someone answers that he/she ismarried and also that he/she is only 12 years old. In that case, aresearcher might want an error message to appear that will suggestchanging one of the answers.

Next to the Field lists 80 and the Rules lists 72, there are a number ofother properties that can be set and retrieved from the Datamodel Object24, such as a Name 82 and a Description 84 for the survey. For Name andDescription the respective functions used to retrieve their respectiveproperties are getName( ) and getDescription( ). These properties canpoint to complex objects such as the Field Object, but also tostraightforward objects such as a simple object to store a text(string). Other important properties and lists on the Datamodel levelinclude the Layout Object 86 and the Database Object 26 (which controlsthe storage of given answers and assignments).

Not all properties need to be defined in order to run a survey. Forexample, one could choose not to add a description to a questionnaire.However, in order to conduct a meaningful survey with a non-trivial MMICfunction, the Datamodel Object 24 should have at least some fields withassigned values and also should have rules that describe how at leastsome of those assignments are determined dynamically as the survey isbeing conducted.

Field Object

Field Objects 70 are the basic building blocks of any questionnaire.They are locations in the database that may be filled with data (such asquestions, responses to questions, or other information that isautomatically assigned based on prior responses or other known data. Asdiscussed earlier, a field can perform different programming roles. TheField Object can be used to store data by asking a question andaccepting a response (using it as a procedure or function), or it can beassigned a value without asking a question (using it as an assignment orvariable).

Below is an example where three Fields ‘Incomequestion’, ‘Yearlyincome’and ‘Monthlyincome’ are potential questions.

Incomequestion “Do you want to give answers to income questions on a peryear or per month base?”: (year, month) Yearlyincome “What is youryearly income in dollars?”: 0..10000000 Monthlyincome “What is yourmonthly income in dollars?”: 0..10000000

The routing (“Rules”) section determines whether which of these Fieldsare going to be asked of the respondent and which will be calculated(“Assigned”) without necessarily explicitly presenting them to therespondent or interviewer.

Incomequestion if Incomequestion = year then Yearlyincome Monthlyincome:= Yearlyincome / 12 else Monthlyincome Yearlyincome := Monthlyincome *12 end if

In the foregoing example, the ‘Incomequestion’ is always asked of therespondent. Depending on the answer given, the follow-up ‘Yearlyincome’and ‘Monthlyincome’ are either asked or assigned to. If the respondentanswers ‘year’ then the ‘Yearlyincome’ is asked and the ‘Monthlyincome’is calculated and assigned by dividing the answer given to‘Yearlyincome’ by 12.

FIG. 12 shows some of the basic components of a Field Object 70. Everyfield can include an associated list 88 of QuestionText Objects 90. AField Object can have a QuestionText Object 90 assigned to it for everylanguage defined on the Datamodel Object level. For example, a surveythat is conducted in the English and Spanish language has twoQuestionText Objects in the “QuestionText” list on the Field Objectlevel, both associated with Fills 92 (Fields 70 that represent responsesrecorded by the interviewer and/or other data objects that supplement orrespond to the associated QuestionText Object 90). Alternatively, theField Object 70 can be a calculated or assigned field (for example, aGPS location) and this Field Object 70 may have a Name 82 and aDescription 84 property, but no actual question text and thus an emptyQuestion Text Object associated with it. Question Texts Objects can alsohold Fills 92, which include references to other Field Objects 70. Thismakes it possible to show personalized question texts based on previousanswers or preloaded data. These referenced Field Objects may be nodifferent in structure from normal Field Objects. FIG. 14 includes adetailed example of a fill.

Every field has one or more statements (rules) assigned to it. Aquestion that is asked only once in the questionnaire has only onestatement. The statement in this case will simply signify that thequestion is being asked of the respondent. More complicated assignments(calculations) have multiple Statement Objects assigned to them. Thesestatements appear on the Datamodel Object level together with all theother statements in the survey and on the Field Object level togetherwith all the other statements that are involved in that particularfield.

Another list on the Field Object 70 level is the Rules list 72. Itcontains the complete list of all the logical conditions 76 that areinvolved in ‘getting to’ a particular field in the questionnaire. Ifthere is a question text (question) that is asked of a certain subgroupof the sample, the conditions that are stored in this structure are theones that must be satisfied before that question is asked.

The Field Object 70 holds properties for the Name 82 and Description 84of an associated question as well as a reference to the Datatype Object94, which describes the data the field can contain. The Datatype Objectwill be described later with reference to FIG. 13.

Four important functions in the Field Object handle the storage andretrieval of the data. Each Field Object has a getText( ) and setText( )function as well as a getFieldStatus( ) and setFieldStatus( ) function.The text functions store the actual data entered by the respondent orinterviewer, where the Field Object status functions determine the typeof answer given. In a case where the respondent refuses to answer aquestion, the text will generally be empty and the Field Object statuswill be set to “refuse”. Data entered into the object is stored in anexternal database such as Oracle or mySQL. Next to the value and statussome more information is stored in the database on a per field base.This information includes the date and time of the entry, the languagein which this question was asked, the interviewing mode (web interview,telephone interview, etc.) and the version of the Datamodel in which thequestion was asked. This information allows researchers to later traceback the exact conditions under which this particular answer was given.This is important in case the survey was designed to be conducted inmultiple modes, allowing the respondent to choose the mode or evencombine modes, for example having telephone follow up questions for aweb based interview. In this case, the researcher will always know inwhat mode each question was answered and even what part of the routingwas ‘opened up’ by switching modes. The researcher can even force newquestions to be asked of a respondent by switching modes and assigningan (new) interview for this respondent on the telephone or other mode.The data collected is independent of the modes and will all be stored inthe same (external) database.

Datatype Object

As shown in FIG. 13, the Datatype Object 94 describes the Type 96 ofdata to be stored for a specific Field Object 70. Some of the possibletypes are: String (text), Integer (numbers) or Enumerated. Enumeratedtypes consist of a list 98 of possible answers 98. An easy yes-noquestion is a simple Enumerated Datatype Object with only two possibleanswers: “Yes” or “No”. When the Datatype is Integer, a Range minimum100 and Range maximum 102 may be specified. An optional AttributesObject (not shown) can be provided on the Datamodel or Field Objectlevel. In addition to a direct answer, respondents are sometimes allowedto answer refusal or don't know to a question or leave a question empty(no answer at all). These attributes can be set per question, block (setof questions) or Datamodel. Accessing the Attributes Object for a fieldtells the programmer what the answer options are for that specificquestion.

The Datatype Object 94 also supports the combination of answer types. Ina question about age, one would typically allow a range from 0.120. Thetype property 96 in the Datatype Object in this case will return‘Integer’, with a range minimum 100 of 0 and a range maximum 102 of 120.Datatype Objects can also be assigned to the Datamodel Object, acting asa global answer type that can be used for all underlying Field Objects.

Layout Object

The Layout Object 86 is another important part of the Datamodel andField Object. It describes the look and feel of the question on thescreen. Not only the color and the font of the question text aredescribed here, but also the location on the screen, and the position ofother possible questions or items (such as movies or images) on the samescreen. Note that the Datamodel Layout Object determines a generic(default) appearance (FIG. 11), which can be modified by thecorresponding Layout Object of a specific Field Object (FIG. 12).

Creating a Datamodel Object

The Datamodel Object contains functions to fill the object withquestions and rules, such as Conditions, Statements, Assignments and(Data) Checks. In order to conduct a survey, information needs to be fedinto the object using functions such as: addField( ), setQuestionText(), addRule( ), etc. At the moment, MMIC uses a parser to navigatethrough a piece of text, allowing for a more convenient way forprogrammers to define a questionnaire using a predefined languagestructure, without needing to write a program that directly uses theMMIC functions. This principle is used in most other programminglanguages. Currently, MMIC supports the Blaise programming language asinput, but we are also planning to support the CASES survey programminglanguage. In addition to the CASES language structure, MMIC plans toimplement two more convenient ways of designing a questionnaire: A webinterface and a more graphically oriented interface. The web interfacecan be used for simple questionnaires and questionnaires where morelanguages are involved. It allows researchers and translators todirectly access the texts used in the questions without inadvertentlycorrupting any associated routings and checks. The graphical userinterface supports a more visual way of designing a questionnaire.Questions are displayed as boxes and arrows that represent the internalrelationship between questions, showing paths and conditions in thequestionnaire. The program then converts the boxes and arrows to thefunctions used in the MMIC Datamodel Object. All these programminginterfaces use the same functions (addField( ), SetQuestionText( ),etc.) to fill the MMIC Datamodel Object.

On the data input side of the survey process, a program retrieves theinformation stored in the MMIC Datamodel Object in order to displayquestions on the screen and allow respondents or interviewers to enterdata (answers) into the Object. There are many known ways and modes todisplay questions and record answers during the course of an interview.The MMIC data entry program that retrieves the question text is able tosupport many of these modes. It can display questions on a screen in atelephone room, allowing interviewers to conduct interviews over thephone, and it can also show questions on the Internet or PDAs to allowself-interviewing. Printing a paper version of the questionnaire is alsocontemplated, which will provide a hard copy that can be sent out byregular mail to the respondents.

Once the data is entered into the MMIC Object, it can be retrieved usingthe Database Object connected to the Datamodel Object or directly fromthe Database in which the data was stored. If the MMIC Object is used toretrieve the data, the users will be able to access all the meta data(Conditions, Statements, Checks, Description) connected to theparticular Field associated with the data that is requested.

Example of Complicated Fill Routing

FIG. 14 shows the source code for a rather complicated example of theuse of a fill in a question text. The code is written in the Blaiseprogramming language. The MMIC survey program preferably includes thecapability to read the source code file from multiple other surveyprogramming languages such as Blaise and CASES. The question text ofField ‘q3’ contains a fill, in this case a reference to the field ‘HWP’,which will appear in the question text for the interviewer or respondentas ‘your husband/wife’ in case the respondent is married. The route tothese fills is fairly complicated and leads through the function‘HWPfill’. During run time, this function is analyzed step by step as itcomes up as Statements and conditions during the interview process. Thedecision process during interviewing is rather simple. We start with thefirst Statement. If this is a question, put the question on the screenand continue analyzing the next Statement or condition until we reach aquestion again. When a condition is reached, analyze the conditionexpression and go either into the ‘then’ part of the condition (in casethe expression equals true) or the ‘else’ part of the condition. If wefollow these simple rules, we will end up with a filled field for ‘HWP’.When the question that uses this fill is supposed to be shown on thescreen, we simply take the value for this field and replace them withthe field name in the question text.

The MMIC Engine retrieves the value for the fills in question text atrun time from the Database Object. At design and compile time however,all the possible paths to the Fill Field Object are stored andaccessible through the Field, Statements and Conditions Object blocks.This allows for a getPossibleFill( ) function which retrieves allpossible Statements that can influence the outcome of the Fill on thescreen. From a meta data point of view (see FIG. 10), this is extremelyuseful to both the programmer (during design and debug) and to theresearcher (during validation and analysis).

Continuous Data Collection

The MMIC Engine is able to run and gather information without actuallyasking any questions. A typical survey guides a respondent orinterviewer through a path of questions until the last question isasked. MMIC is able to run without conventional text-based questions andto gather data without the need of respondent interaction. Oneillustrative example of where and how MMIC can be used is in thetelevision and radio audience measurement Field. MMIC could operatesilently in the background and record all the channels that are beingwatched, and even pop up some questions on the television when a certainshow in on. Another similar example is that MMIC can follow Internetbrowsing behavior and pop up questions in the browser when the userperforms certain activities, such as searches for specific pages.

Screen Dumps of Some of the MMIC Components Possible Extensions andVariations

Those skilled in the art will undoubtedly recognize that the describedembodiments can be assembled in various ways to form a variety ofapplications based on the need, and that obvious alterations and changesin the described structure may be practiced without departingmeaningfully from the principles, spirit and scope of this invention.

For example, MMIC could be provided with a web-based programminginterface that displays a questionnaire generator on the web, allowingusers to click together a simple questionnaire without the use of (orindeed, any knowledge of) the MMIC programming language. Such aweb-based interface could then create and compile a MMIC Object byassigning fields and routing (conditions, statements and checks)directly to the Datamodel Object, which could be subsequently decompiledinto any supported source code (for example, Blaise or Cases), eventhough it was created on the web. This decompiled source code could thenbe altered (perhaps with the original text of questions and interviewerprompts translated into another language) using the particularprogramming language appropriate for the resultant decompiled sourcecode and recompiled again. Alternatively, such a web-based programinterface could be used to translate or modify a MMIC Object that wasoriginally compiled using any supported programming language and thendecompiled into a format compatible with the web program.

As another example, MMIC could be provided with dynamic bidirectionallinkages between the Engine, the Programming Interface, and theInterview Interface. At any time during the running of a survey program,the programmer could jump from the current program display to thecorresponding line in the source code and then step through thedifferent lines while viewing the corresponding actions in the surveyprocess.

Accordingly, these and other alterations and changes should not beconstrued as substantial deviations from the present invention as setforth in the appended claims.

1. Method of modifying a questionnaire for an interview-based survey,comprising the steps: using a first survey programming language havingan associated first compiler to define a first source file for a surveyquestionnaire; using the first compiler to compile the first source fileinto a Datamodel object; decompiling the Datamodel object into a secondsource file; modifying the second source file; and compiling themodified second source file into a modified Datamodel object,
 2. Themethod of claim 1, wherein a same survey Engine is used to run both theunmodified Datamodel object and the modified Datamodel object.
 3. Themethod of claim 2, wherein: the second source file is defined by asecond survey programming language; the modified source file is compiledby a second compiler associated with the second survey programminglanguage; and the first source file is not compilable with the secondcompiler and the second source file is not compilable with the firstcompiler.
 4. The method of claim 1, wherein the Datamodel objectincludes field objects organized in a relational structure in which thesame Field object can be accessed from more than one previous Fieldobject and in which the same Field object can lead to more than onesubsequent Field object.
 5. The method of claim 4, wherein therelational structure permits a particular Field object to be accessedmore than once during the same interview.
 6. The method of claim 5,wherein the relational structure permits a particular Field object tolead recursively to that same field object.
 7. The method of claim 1,wherein modifying the second source files includes addition questionsand answer choices from another language.